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Ac-atracl 

An algorithm i* presented tor do tar li i ni ng, the values which 
Biaul tanaoualy eatiafy a oat of relations, nr conj train la, Involving 
different subset* of fl variables. ThG relatione ars represented In a 
series of Conatralnt netuoritj, uhith ultinatsly coitain a nnde for every 
eubaet of the n variables. Constrai-ntB mag b* propagated through #«eh 
network* in (potentially! parallel fashion to determine the values which 
aimu I taneouely satisfy ail tha constralntf* The Iterated constraint 
propagation aarvfla to mitigate combine tort a I e^p lotion* Application's in 
scene analysis, yraph theory,, and backtrack search are provided^ 
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1. Sat lifting si&iul tarmog* constraints! problem and applications 

Ue 3ra given S est at variables K< K n and Constraint* on SUbi8«ta 

of these variables limiting the vaiuaa they can taks on. Thess constraints 
taken together constitute a global constraint which specifies which sets of 
values 9^ t i..»B n tor K| f ,P,,X n can s»mul taneously satisfy all the given 
eonrtfalnts* In Other U«rdt r tn* constraint* define an n-ary relation. 
Our- problem is to tynth**i« tftla relation,, i.e. to determine these sets of 
value* which tlmul tsnsoutiy satisfy the set ot constraints* 

Th* simultaneous satisfaction of isveral constraint* — call them 
properties^ relationships^ prsdicatea h featuraa or attributes.-- 1 * a v*ry 
general problem, Mith mors applications than ] cam fully survey hare. The 
essential tccH-niquo J? O^'pu, iUraTni! .' e fJL r: 1 i on of possibilities througn 
constraint propagation, hat analogues In many $r*tt d* computer science and 
mathematics. ' Many of these applications and analogues are described kjn 
(151 h [111 and {241. Applications range from data base retrieval (find ah I 
H* y and z "tied thai « I-* a part and y it a part, and c le a suppler, k 
pust be innH-ii »d before y, and 1 supplies both h and y> I see also [121) to 
scene analgia Ucgmsnt th* SCSne Into regions such that efcy regions are 
blue T grass regions are green, and car regions ars shiny, sky regions are 
abevg grass region* and car* art no I totally turroundsd by either grass or 
sky). Of particular note is the nark of JtH+ Ul lean, who has used 
Constraint propagation irethoda in a variety of contents, ranging from 
pattern recognition (101 to graph isonorphisr* [21]. The problem a I bo 
admits of a graphical represent at Ion, uhere its ressmb lanes to networks D f 



interacting procas&es con jura* up a long hi story pf ether MOrk T including 
recent I ys [SI, lift and [61. 

In seen* analysis, in particular, thero has been a recent groimdswell 
Of applications, e.g. Ill, [IE], t31 ► (131, 'Sacral of the latest s*ar»p1ea 
can fa a fc^nd in [3] h 

Of tan ua an only given, or chooss to ubb 4 H lecar eenttralnts, l.e, 
constraint! on shall subsets of the variables, free. Mhlch Ha Must 
synthesize the global constraint. Far tundeetnt il results on the 
complementary Problem, analysis of d global constraint into local ones, see 
[14] . 



2* Previous results: partial consistency; ■ 

Constraints represented in nstwork form nay be propagated through 
{potentially) parallel algorithms which Cut down ths solution search space 
by ruling out Inconsistent combinations of values, 

The- obvious brute fores approach of tasting every pot si to I* combination 
of values faces an squally obvious canb inator i a I explosion^ BaCi track 
search techniques cut down the search spaci but often inhibit costly 
■thrashing' behavior [171 E2), flackuorth [111 has interpreted previous 
kork by Fikss C71 H Walt? [23] and Mpntanari US) «1 cutting dMfl the Search 
space and avoiding classes of thrashing behavior by eliminating 
copbi nations of values uhich could net appear together in any set 
eatiafying the global constraint. 



A network ruprgsen tation of a eat of eonilrainte ib employed 
(restricted to unary and binary constraint^ predicate* on One Or two 
v-bp iabf»#) d Each variable Ib repreaentid by a noda h and each binary 
predicate by a link or arc batuean two n.odes r (Loops on a node nay be 
viftnod as binary nr unary prad I cat**< ) Fcr example, the problem af 
coloring a tuo npde complete graph with One color can bs reprapented a a In 
Figure 2* 1 , 

(_[^ (red graenl^ irstf greonlj ~) 

F j.-.-n 2.1 

In the figure, frad graanlj and Ired grtenlj are the initial domains of 
values far K^ arid Xj respectively, the predicate at each nod* It "colored 
red" and the binary predicate between the nqde* It "it not the oa*fl color 
am*. 

Hacfcuortn dletinguiahee three levels of inconi I tteney for a constraint 
neluoi-k, Hhicti represent come 1 na 1 I on* 0* values which cannot participate in 
any iolutlon to tba global constraint, The first and Host cbvloue ie node 
inconsistency. Hare the potential domain Of valuaa for X* and Xj ia given 
as red and green, but the unary predicates specify red. Ue can timed lately 
eliminate green fron both nadea, as in Figure 2»2> 

(3 Ired gVieXlj [red di*Mitl z 3 

Figure 2,2 



The ns*t In vol gf IneonaiBtsncy It ire inconsistency* the arc from X, 
to K^ la Inconsistent because for a value i n X , p namely "red",, there doe* 
not BKiat any value a z in X^ tueh thit red anti S 2 together satisfy the 
relation "red la not the san* color an a^*. To remedy this tncontlttsncy 
ue reecve red fro* Xj, and similarly* from Xj> Thin cute dOMn Our search 
apace ill riyhti unfortunats I u, In this cat* It raflacts the +aet that the 
problaa la 1*poa*ible, Tht^t I* no global solution, i.e. the netuorh li 
what t call "tmsatisf iablaV 

It it entlrsly possible for a network to have no arc inconsistencies, 
and still be unsatref table. Contidsr the problem of coloring a complete 
three rode graph with two colors, represented in Figure 2 + 3, 

I red greenly 

trad gresri] ^ — ^— ^— Irad flreenlg 

Figure 2*3 

Aaeuma tha St t of pd-aaiola values for tech variable i a Ired grten, and th* 
binary predicate betmen each pair again specifies "ia not the name color 
as". 

This nstuork Is arc consistent, e.g. given a value "red" for X* t ue 
can choose "green* for Kj: red ia not the tame color as green. Yet 
obviously there is no usy at choosing singls values a^ a Zl 33+ for Xi , X^, 
and x^., tuch that all three binary constraint* are eatlefied 
simultaneously. If ue Choose red. Tor X,, for esiamule, wa are farced to 
Choote green for Xj. to satltfy the constraint belueen X* and X,. Thie 



forces a choice of red for Xn r uhicfi farces a choice of grtin for X^ T 
«lr**<tyi picked to be red. 

Nevertheless, It mag oe hi I p-f-U I to remove ape ineansietenciee frap a 
network- Thle involves comparing node* Mi th tnftir ne I ghee p * as ue did 
ebciwft. Each node must be bo compared: however, comparison* ear* cause 
changes [deletions) in the network and 10 fh* comparisone must be Iterated 
until a stable netnork it r*acfi*0. These Iterations can propagatft 
constraint* acme diatance through tha natuork. The coapar I eons at each 
nod* can theoretically be performed in parallel and thlt parallel paee 
1 t era ted. 

Thus removing arc 5nC0n*| atanc 1 89 involves eeveral distinct ideas t 
local constraints are globally propayaCed through Iteration of parallel 
local operation*! It renains to be seen uhicn aepecte of thift process are 
Most significant to its application* The parallel possibilities mag prove 
to be particularly important] however, at the moment serial 
implementation* are u*et* in practice. 

Ualtz "filtering" algorithm for *cen* labelling L231 is the paradlg* 
example of an arc consistency algorithm. Ua I tl ui»h4t to attach labels to 
the lintl In a line draulng indicating their semantic interpretation* as 
convex, concave or occluding three-dimenelcnal edgse. Tha line tfrgw'Tg 
Itself functions a* the constraint network. Vertices function 91 netwrk 
node** An individual vertex value consists of a label for each of the 
linee incident to the vertex: ths sst Of potllble vsiuea is initially 
constrained according to realizable three diHSniional interpratat I one for 
the various typea of vertices. The lines are the art* Of the network and 



each represents the relation " tht label I ingo of the adjacent vertices must 
agree along thin I in**, 

Ualtz filtering algorithm {eKpeclaMy when further con i t r a i mad by 
opacifying Initial labels fpr edge* on the background) generally raguMl In 
an amazing combinatorial reduction] thousands Of poestd I i It 1 1 e* arc often 
reduced to- a state uhere ell nodee have a single value remaining, thus 
totally solving the problem of obtaining the global solution. Of course 
the algorithm does not always tern! pats with a unique value ait each nod*. 
Generally, in this caes. most, nodes Mill still have a unique value, while p 
feu nodea ull I have a srtall sat nf values remaining. Normal ly this final 
state indicate* that ssvsral ambiguous interpretat i one are possibles 
alternative set? of values that simul tana&uMy satiety all constraint* can 
be Quickly found with tree search. 

It la perhaps not as well appreciated that this final state may alao 
be reached for a figure which In fact adults no consistent labelling. This 
ig to be Suspected, however* given that the filtering algorithm only 
achieves arc consistency. Given the Caaic Huffman I ate I eet tlBl 141 Enot 
Waltz" expanded label ietl and applying the filtering algorithm (without 
first constraining the outild* tinea to bs occlusions^ th« line drawing in 
Figure 2*4 is left label lad as shewn. 
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Figure 2.4 



However, there it no consistent choice df labels fo<* ths vertical of the 
Inner triangle. In other *JOrds the filtering algnri^nn alnno will not 
determine If a line drawing ■! wnat Huflman calls an " impossible figura", 

tlomtanarl [15] ha* developed a mars pausrful notion of inconsistency 
Mhlch M*ckKgrthi calls path. I rtconii itwPCU, A network is path Inconei stent 
if thare are two nods* Mi and X, SYch that a satisfies Xj + 6 satisfis* M^ 1 
a and o togethEr satisfy the binary constraint betueon 5ri«=m. yet there la 
soma other path through ths network froH Xj to X^, such that there is no 
«•+, of valuee H one for each node along the pa|h N which include! a and b, 
■rid can • ifflul t»n*OUSly aatiafy all constraints along the path* For 
e*atiplB, the rtituork In Figure 2.3 is path lncon*istsnti red satLttlea X^, 
green X3, rttf ll not the sane calar as grssni houevsr-,, thsre It no value 
for X^ whicfi uill satisfy the constraints petuesn Xj and Kj, and between M2 
and Xg, Hhile Xj Id rod, H3 .a green. 

ttontanarl gives an algorithm that essentially removes r.i*th 



incontiatenc iee from a nttuorK, HoNeven path coniltency dca* not 
"Iflcosaarily insure satisfiability aither h as poutrftil •• it eounos. 
Coneidar the problem of coloring tha conplete four node graph with three 
colors IFigura 2,5) p 




lr g blj -^|r g bf 3 

Fi gure 2 T 5 

Each node contain* red, green and Blue* and aaeh arc Sgalrt represents the 
relation "is not tha aama color at" ► ]n particular, path coneietency does 
not fully datormin* th* tat of values satisfying the global constraint, 
Hhich in thia 1 neons latent ea« it tha oUpty set. 

In eummaru,, arc and path eonsiitency algorithms may r-aduce tha search 
apace, but do not in general fully tunthatllt toe global conetraint* Whan 
there aro auTtiple solutions, additional taarch Mill be required to apeoify 
tha several acceptable combination* Of values. Evan a unique solution nay 
require further tewch to dtttrdlne, and tha consistency algorithms nay 
even fail to reveal that no tolullont at all t*ilt + 



3» An extended theory 

A* th* coloring problem auggasts, ths Cieneral problen of synthesizing, 
the globs I constraint j B NP-cohpletB [5], and thus unlikely to have an 
ufficiftnt (polynomial tins) solution* On th>p other hand th* experimental 
results of Waltz, and the theoretical studies of f1ontanari> suggest thai in 
specific applications it nay be possible to grsatly faci i i tato the Search 
for solutions. I Mill present an algorithm for a yn t he* 1 Z i ngj the n-ary 
COftStre-lnt defined by a set of constraints «i eubaets of n var iablee. l\ 
may be of substantial benefit in 3pp I ieet iona where pruning Of arc and path 
inconsistencies still lea^aa hang poetl bl I 1 1 lee to Be eearchtd. 

There are tuo key observations that motivated the algorithm, H 

U Node 4 arc and path consi Stsncy in a constraint nstMOrk for n 
variables can be generalized to a concept of fc-ccna I s tency for any kin, 
uhere n-coneletency constitutes a natural notion of global consistency. 

2, The given constraints can b« represented by nodes* as opt^oeed to 
link*. In a constraint networks us can add nodes representing k-ary 
constraints to a constraint network fqr ail kin (whether or not a 
corresponding fc-ary -constraint is given): and we can thsn propagate these 
constraints in this augnanted net to Obtain higher Isvels of consistency. 

By guccill I vel y adding higher Iftval nodiB to the nstwork and 
propagating constraints in the augmented net, hb can achieve k-a>ry 
consistency for all k, Ue do not need to restrict the given constraints to 
binary rotations, Ruling put lower ardor iftCOn* i e teneiea in stage* 
prcgroBal vely relne in the combinatorial explosion. The final result ie a 



global I g consistent net work, where the n-ary node Boecltiss explicitly the 
n-ary conotraint ua ate* to synthesize. Mo further search U required. 
The rttt of thil p«ptr uU I present the algorithm, along tilth « tufflcient 
theoretical baas to justify i ts operat i en, 



4. A pral iminary example ot the iunthaaia algorithm 

1 ulll give a crude exanple Of the euntheaie algorithm In operation, 
by way ot mot Nation for tht fornal description union fclloue. The 
presentation in this ■action it intentionally akatctiy. 

Suppose US' ara given the fol louing conatrainta on varlsbhea X| . Xn, 
X^i The unary constraint C^ spec i Met I hat Kj Mtt be either a or b> i.e. 
C^-la 01 „ Sinilerlyi C2-E0 f> and Cj-k d g] < The binary cnnatraint on Xj 
ami K^ epeclfSee that either Xj It b and ^ is e, or X^ ie b and X^ la fi 
C i2 -li3o pf-l, Lihawie-e C 13 -[&e M bgl and C^-fect fgK 

U« ulth to determine uhat ehe-ieea for Kt. K^, H3. if any, can 
si mu( taneoua ly tatiify ail these constraints. Ue begin building the 
constraint nttuork with three nodes representing the unary constraints on 
the three varisblea, as ehown In Figure 4.1* 



fe n z 



la blj Ic d gh 3 

Figure 4*1 



Next ma aded nodea rn&rsseptiflg tha binary constraint a, and link tham to the 
unary eonatralnti a« ShoWl in Figure 4.2 la.g, (ba b<Kn repraaente C,,! ■ 
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1oe bff^j iea lg>23 

la b)^ — Ibc frd bgit 13 — Ic d gl 3 

Fiflure 4.2 

Alter ub add and link noda C^ HB ' ook a * rodfl ^1 * nd find tfiat 
tlanant a doea not occur in any manner of Cit* Ma (Islet* P Iron C| * 
Similarly, ua da let a c from Cn after adding €33* The eoraatra'lint netuerk now 
apptari aa in Figure 4.3. 

r* 11 , 

Ibe bfl ^ I* 4 f 0',23 

fa u^ — (be tod bg> 13 — ^ d gl 3 

Figure 4.3 

Hon from C3 wa look at C13 and find that there ia an pigment bg In C13 

which require* c il I Vllut tor M3, while c ia no longer in Cg. Ma remove 
be Irom C]^ t a* in Figure 4<4, 



[t flj 

Ibe btl 12 Eec * f ^23 

Lb] , [6i bd Ogl^—ld qI? 

■ 
Figure 4,4 

So far hb have merglj achieved a sort at "arc cops i ntency M t though u« 
Indicate the raatrictian of the pa'r tic, as wall aa the elementa a and cK 
Next* ue add a node for the ternary constraint. No order three 
conatrsint ua« given original lg T *o uo could attune Initially the 
"nan-ccnatralnf, all paaaibla triple*- HflMaVar , HI hH I take advantage of 
the restrictions, available frtih the binary and unary predicate* to 
construct a more limited aet of paas i b-i I i t i ss. Cj 9nd Cj-j together alien 
only the fallowing set of triples: (bed btgl , LJo utt thlt aa the ternary 
node and link it to the binary nadee- as sicdr* In Figure 4*5* 



le f\ 2 . 



Iba Of I ,X load bfg) ,nj — -■ led fgl^S 

■ "** I """^^ 

Iblf^ Ibd bgt l3 — Id g) 3 

Figure 4,5 

Me look el the new noda from its neighbors and vica versa, a a h* did 
earlier, to lnayra con a i ateney of the a-or t we obtained earlier t>rlu«pn 
neighboring nodaa. Cjn is consistent with the new node; bd le part of 
bed* bg part of- bfg- Similarly Cj? and C73 are conai stent with the ternary 



nod*. If necessary, ue could propagate deletions around until local 
conaiaterccy ha achieved on thia augmented network. However , ir ttili casa, 
the nfr^wjr^ la already stab I a; no fi*"tti*r changes are required. 

Thfl tarnaru node represents the eynthetie Of the given ccnatral nta. 
Tree* are two uaya to s i mu I tarvaout I U satisfy ths given constraint?! X*-o f 
Xj*8, Xj»d ar X.^b N Xn.«f N Kn»j H 



5. Basic 04 M til t i cnsj constraint empress i-one, constraint networks and 
eat I of iabl I 1 ty 

This section present* several definitions needed to etats the probkea 
W*d its. solution precisely. 

Ur are given a set of varl^bU) Xj_ pt .,,H r which may, take on values 
fro* a set of universes U| r , f1 ,IU n rggpect ivefy, Ue ui I I aaeuive the U^ to 
aa tiiiGrete h finite domslns. Let [-11 2 nn nl , Hsny of our definitions 
nill be made, for any subset Jd > Ue denote b-u Xj the indexed est of 
variable* (X.) j£j . A value s, In \i ] Hi I f be called an instantiation of 
M], An instantiation of a set ot variables Kj, denoted by aj, L ia an 
Indtxfed iet of values Is, I, r. 

A constraint on Xj, denoted Cj. It e eat of instantiations of Xj, 
Tht ■ Indexed est* notation Implies that there is a function a H fro* J 
onto the instantiation aj H which ttrvu to indicate which eEmber of aj 
instantiates which variable, the value of a at j. denoted a., le the 
■ ne tan t i at ion . of X-„ Lie could a I bo represent aj ee an ordarad tat or 



W-tufjIe, uhere « is the nunber of b laments in the oat J (called the 
cardinality 0* J and denoted |Jf|* a,.(a a, f r a. In U- , j - -c j. 

far l<k, i,k-l + , , hl fn. Thus Cj nay he thought of a a «n *i-aru. rslatlqn, 1 

have found It useful, however, to ubb set notation rathsr than refer to 

Cross product? e«* predicates in trie prestation uhich foHowa. Given a, t 

"ijtaj - uill denote the Instantiation of %r contained in «■, 

A constraint eworeeBion of ordsr n is a conjunction of constraints 

£~ ™ Cj, ono- constraint far Bach suQsit J of I leKcapt the Mpty subset} . 
Jt2 ! 

Normally «• ulll not be a m p I t c i 1 1 u glv»n constraints far all Jch 
hBHsvsr, uie c&n aesum.* they exist, uith no lose of generality, a* tha "non 
constraint" for Xj can aluays be *B*ciHsd> the set; of all to*b i nations of 
elements fro*i tha domains of th* ya^ac-lss in ttj. 

Ua say that an instant I at ion aj aatisf ies a constraint Cj if ajtCj. 
The i na tant i at ion 3j satisfies a constraint Cu< HfiJ, if the set 
l»j{3jl j € |_^ „ uhich ms call aj rBatrlctsd to H, is a member of Cu. An 
instantiation- 8j, where |J|«k» k-33t : af ies a constraint **pr t b s 1 o n of 
order nfcK, if aj satisfies thi constraints C H foe iM HcJ T If an 
Instantiation aj n-aatisfias the constraint SKprBssion of or-der n, we say 
that B^ sat i Bf i es the flMpratslonu * constraint impression C is 
K-»atisf iaule if for all cardinality k subsets J of I, there exists an aj 
such that aj fc-ealisfiea C. If C of order n is n-sat iaf iable it Is said to 
be sat i b f i abl e . 

A conjunction of Constraints, a constraint Suprsssion, defines another 
constraint; tha Bet or all ina lant ia( iona a c which satisfy lh« constraint 
■wpreBBion. Our central probiem 1b la eynthaaiie (hs order n constraint on 



Ki defined by the constraint eKfrr«*aion. ' L *' to determine explicitly th* 
set Qf instantiations »[ which ■ <mil tsrronuBly satisfy ill the given 
conBtraintS + An instantiation: Si whicn •Stltfies C I* called a solution of 
the constraint eHpreeeicn* 

A conatrglnt netuork of order K Id fl variables^ kin. is a set of 
constraints celled ngdga t Nt p for each JCl , IJlik, Wfiere a I Ink 1b said to 
Ski it between Nj and H H If HfiJ and |H|-|J|-t. Linked nodaa are called 
neighbors* ft constraint network of ordt>r n ln> n variables mil bo ca I I ed a 
ful I constraint network. A nods Nj Is said to correspond to a given 
constraint Cj if Nj-Cj, i-.e. each Instant pat inn of on* Is a member of the 
oihflr, ft fyll constraint network in n var 'Soles corresponds to a 
conetraint expression of ordar n If each node Nj in the network 
corrsepcnde to the tonslrs Inl Cj in- the eypreesion. The Order of a node 
Nj, or a constraint Cj, It the cerdlnality of J. 

For example, the network in Figure 5.1 corraBpcnde to the constraint 



expression C- A Cj , Where* 1-H 21 , Cj«£r gl , C^- [r gl , Cjj - ^ r fl G r ' ■ 
II avoid set notation in the subscripts for siiFfil icity J 

|r g}^ — — -Ira, grf^ ' r B^ 

F Igure 5*1 

Tftie le obviously a repreasntation of the probl** of coloring a two node 
graph with tuo colors* 

A* nodes era constraints us are ab I • to restate all the above 
Definitions Involving sat iiefi ability In terms of node* end networks, rather 



thin constraints and constraint a* pr g aa i cms. I n particular we can apeak of 
■n inttartt i at ion 5j satisfying a ncds N_i far HtJ. U« a 1*0 uU I want to 
talk stout aj satisfying ^ for H=J. Us uill aay that aj sat '< a Mas IMll* 
Hsj, If there exists an a u in H^ auch that la/a^l . j-aj, I - e+ there le ao 
instantiation Hhich saUafiaa N^ Uhose restriction to J i* aj* 



G. Constraint propagation 

Ue can ngu de+ing the basic constraint propagation mechanism. To 
J P^ai I ly propagat* the constraint Hj to a ne i ghbor I r*g constraint N H . remove 
frcn H^ alt a^ which do not tatiaty Nj, Global propagation Is da fined 
recur siva I u- To g I opa I ly propagate a constraint Nj through a nalghboring 
constraint N^: tlrat locally propagate Nj to Nut then* if anuthing uatj 
removed fron Nu, by the local propagat 'on ( globally propagtftt Nu through all 
ita neighbors *Hc*pt Nj, To propagate a constraint Uj, globally propagate 
Nj through all Ita neighbors* The propagation procedure ia aimilar to an 
arc conilsttncy algorithm, flackworth diacua. as a efficient tsrJal algorithm! 
for arc conaietency [UK Of course, a parallel implementation is 
posa i bl e. 

A constraint network If said to be relaxed if ue can propagate every 
constraint Nj In the nttwork without Gauging any change {deletions from 
nodeal in the n*ti Th* rgl a*3t i o n of a constraint netuorfe is Ihe neluorh. 
obtained by propagating all nodes of the network. (The propagation 
obviously t a rm i na tes in a re J axed ho t Hurk+ ) 



7* Synthesis algcrl tM 

Ub are new ready to state the aynthesi b algorithm. The ClS'», to be 
proven in aegtion 18* is -that this algorithm, givan 3 constraint 
ewproeeicn, produces a constraint network whOM 0«-dt"' n r»0<lfl corresponds to 
the order n cnnatraint defined Dy the constraint expi-fta s 1 Ml ■ 

ALGOnJThH] 

Ginn C» A Cj* U« <leMn« the elgorithn inductively) 
JcZ 1 

STEP 1j Construct 1 conitrstm network ultfi nodea Nj corresponding to 
conitrslntt Cj In the jlviri constraint erfpreasion, for all Jcl of 
cardinal ■ ty one* 

STEP k+l( For all Jsl o* cardinality k*lt 

Add the nod* Nj to the. natkorfc corresponding to the given constraint 
Cj* Link Nj to all N^ such that H it a cardinal itu k subset of J, 

Local ly propagate to Nj from each of its neighbors* Propagate Hj. 

For a constraint eKpreasion of order n, ths algorlth** it run for n 
steps. The result ia a full constraint network, where N[ eorrssponde to C 

The newt section will present several s^anples Ot the algorithm In 
operation. First a feu general oOaarvat i nns. The network produced by this 
algorithm Is the relaxation n * the network correspond i ng to C. We coy Id 
have oUEalnecl It a Imply by pullding. the corresponding order n network and 



propagating each node. By proceeding in stage? we take advantase of the 
elimination of possibilities tha-l (nay occur at each stage to mitigate 
combinatorial explosion* Urn take this principle further and propagate each 
node a* It 1* added, before adding another. A good heurletle would be fa 
adtf #*rfier- thOM nodea which exert a hj|*V|| constraint, e,g. where Cj is 
•nail. The propagation of thnse constraint* may allnjnale a lament s fro* 
node* uaed In COnetruqting later conatrelnts* J f Cj la the non-con s t ra rnt 
we can ccnitruct Kj Initially fro* some Jl H and Hj_ H > wher* H , g a 
cardinality k subset nf J„ prefsrabiy the on* for which |Nj^|Nr_ H | la a 
minimum, [bad to each Hamper of Hu each member of H,u r ) 

Other refinement! are clearly possible. Provision ehou3d be hide for 
early termination^ e,g h aa aoon as -one node baconas eirpty. Propagation can 
t» a imp I if led+ l<D, by noting non-conetra Int I, or ueing complement* of 
nodes* Additional links could par-nit direct propagation between a node N. 
and tfra node? for a I I aubaefcs of J f 

It ia generally redundant to require all nOn-cona train t nodes; 
basically Mt wily need one "path" up to tht n-ary node for twery Veal" 
conetr«lntH Consider a constraint expression on four variables where only 
the binary Conetraints are rsaMy specified tthi Othera are 
non-cons tra i n t a ) . Only the binary constraints can really have any effect 
on the global solution. Thr?a ternary nodes ire aufflcient for tna network 
constructed by the algorithm. If the fourth ternary node ru I es out any 
»<eeent of the order four node, it it only reflecting a binary constraint, 
which is reflected in nne of the Other ternary nodes* On the other frarid we 
*ay be interetted in the affect* on non-constraints vf the propagation 



process. In general the pruning proe-eas of the algorithm proorteo iwe I y 
aakfl-B Explicit at Nj reitr ict ions an instantiation* of Xj that are not 
original I lj given by Cr, but rather implied by the other- constraints, [n 
the final network produced by the algorithm every member of every Nj is 
part of acme eolution of the constraint BKpreaalon. Iln particular, we 
hflva derived the "mini Hal" network, rferrtsnarl 1 * "central prob la-It" [l&l ■ I 



8. Further examples: graph CO l«r iny. scene labelling, graph ieomorpfti e» 

Aa the ayntheaie problem is auch a general one, the aynth**!* 
algori this has *any potential applications, Graph prob lams, of cour B *, lend 
themeelvea particularly to a eofletrilnt network formulation. 1 praitnl in 
th i a section tores application* which ul I I serve to illustrate the 
atcorithm, and are Of tome independent interest aa well. 

Aa us would expect frch ths discussion in section 2, th* graph 
coloring- problo* can easily be represented as a constraint network. Given 
S graph G, and a set of cohere* us construct a constraint n#tworfc from G aa 
folloual Each nedG of G itt replaced oy the unary constraint representing 
the aat of colore. If there la an Odgo between nodes in G. we replace it 
by a binary constraint linked to th* (lOdas Which repraaenta "is not the 
same color as -1 . If there is no link between npdee in G H we add the 
non-constraint between the node 9 1. 

Lot ue consider two BKaholea- First consrdsr ths problem n?f coloring 
a complete thrse nods graph with (hree colors. Figuraa 8,1a, 8,1b and fl.lc 



shou the constraint netuork «ftar steps oni, tuc and thres of the 
algorithm, khere ths nodes hlj. Nj H Ng are all the set ir g bl , N^, Nj 3 and 
Nj 3 all equal fro rd or g& br bgF and « 1Z3 - Irgb rbg Org bgr grn gjbrl + the 
six possible color i-ng-a. 
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N 1Z ■ N 23 



Nj i N 13 — N 3 
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N I2 — N 123 ■ N 23 

{ 

8.1c 

■ 

Figure S.I 

Ue- could Construct a netuork cf the flftr[ ms u«sd in section 2, for this 
prooloH. HouuvBr the netuork would be path Consistent! arc and path 
consistency algorithms, uould not rulft out any elements at the nodes-. 

Consider ncu the pro&ltm of coloring a complete four node graph with 
Ih^flft colors, which us used In section 2 to illustrate that path 
comietsrvcu Is not a sufficient condition for eat laf laoil Hy, After the 



third i tap of the a I get" Ethfi ue uguld have four ternary nodes, each aqua I to 
the ternary node in the pray'ioua axafablBr 

At the beg Inning of the fourth step ue use Nsjg and N^ to construct an 

order tour noeJai ^1234" lr a& r ""a^g r Q fil > rb Q r rb Q.g r " tj b br fl r 6r 39 &r sP b 9 rr 
bgrg bgrb gr-br g^bg grbb gljf-r g&rg gbrbl . Local propagation fro* th* other 
tAritary node* quickly reduces the order (our nude tu the elvpty Sftt land 
thle conetraint propagates back duun tu ranove all eletoint* fro* #N the 
nodes]. No instantiation Of the order four node Hill elnul taneaualy 
e-3 t i e f -.j tho fduf tiTi.-ry nodes. Lnsat : &' iatei I i ty is denons (rated. 

Theae enahpl** a*"* rather perverse caaea K of courae. though they do 
Illustrate point* with ratptct to lha discussion in sect ion 2. Applications 
in the scene labelling domain generally involve more propagation than 
occurs in the coloring problem,. 7he eynttiesis algor-itrin does function as a 
test far impassible fig,urss f It also find* all the Interpretations in an 
ambiguous figure. You IpSu nan! to simulate the a Igor I the on a a i tuple 
figure like that in figure S\2. 




Figur* g,Z 

After the Waltz filtering. algcrl \hm is run on the Huffman label set 
(Lai thout additional constraint a on the background labelling!) there are 
three labels taft at each order two vertex and tUO at each order three 

vertex. 



For a final example,, we take graph iaDmDrphlam. Given two graph? G 
and H, which we wish to tost for- i Bomorph i am, conetruct a constraint 
network from C as follows. (I f H has mare nadea than G the algorithm m I I 
•••h i amorphic nappinja of G onto a-u^g- aph a of H, \ Rap I ace each nods' of Q 
with a unary constraint nod* containing all th* n&d*i of H + (If us allow 
I OOP 9 , a-tfgaa from a node to Haelff the unary constraint on a nods in G 
with a loop Mill oo "has a loop in H" N on a node in & without a loop, "has 
no loop in H" ', Us could also i nccrporatn additional unary conotralnts «uch 
as the order of the vertex [22] J Hec'-Jco each edge between nodea a and b 
in G with a binary conatralnt node, linked to the unary nodes for a and b, 
This binary node will represent the conatralnt *thaee two (.distinct) nodes 
share an edge in M H r In other uordi th* binary constraint will contain a 
pair xy if and only If ttitra la ar> odgt bttwian « and u In Hi Batwean two 
nodes which do not there an edge ' n G ub 3bq place a binary node, linked 
to thsm, but raprtienttng; the constraint "these two (diatlnctt nodea do not 
ahara an edge in H" t 

For examplet given the grapha G and H in Figure 3,3 
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G H 

Figure 8.3 
we produce the constraint network in Figurs B. *. 



\ .3 



z<* 



(1 2 31 



112 21 ( 



3D 



1L 2 31, 



U3 31 23 323 



(13 31 11 %2\ 



Figure 9. A 



ac 



be 



U 2 3), 



Propagat mQ CDn-Htraint*, M* Obtain tho rtatuork in Figur* i5, 
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Ndu adding th* ternary noda- ua cubtelfi F I gur# 3,6. 
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This network la relaxed. The ternary node represents the two possible 
iBomorphisaeJ 8-jI, b->2, c->3 and s->2 f b-il, c->3. 1 The- algorithm also 
finds ie-OMrphic au&grapha along the uay.l 

In the acovg appHcat Ions, the desired global state 1* defined in 
terns of local Conetrainte. Often mi firat face an analygis broblem; 
choosing, or learning* a net of local constraint* that specify Or 
approylmats th* daeired g local state tZflln (An important concern hill be 
ths Choice of a H gond H constraint SNpreas i on„ i.s. en* that can be 
synthesized ef f icllnt lg»} As ue explore vario-js applications, it will, of 
course, be equably r mpor t an t to develop theoretical e*thod» for analyzing 
the performance of the alc-C-rith* in a given domain. 



9* Consistency and campletare&a 

The Synthesis algorithm operates by rationing highsr and higher level 
inconsistencies until a global consistency has been achieved- In thli 
Section^ | define this lequenca Of coneistan^y ttlttt, and alto define a 
concept of cempletenasH wh I en ue will mint lo apply to a network. 

A nodi Nj of -nrdnr k is k-conelatpnj with a constraint expression C 
if all Niedbers of Nj It-satisfy £, A network of order fc or greater Is 
k -con* ■ • f«n t with C if all nodes of order k are fc -tonal stent with C. if a 
full constraint network of ordsr n \a n-cpn*i etant with a constra i n t 
expression C of erdar n we aay that it la coneletcnt ulth C+ 



A node Nj of order h la k-cQMplote for C if any i nstan t iat 1 on a, 
which k-satisfies C i9 a hefrbar of Nj. A network N Is k-c&wplete for C if 
ivory node of order k ie k-complttB< An n-conpleta full constraint network 
of Order n in said to oe conp I a t 1 ■ 

A feu gamta-nts may bo in ordar to relate the consistency -not ion* 
described in this section to the background Cll ecuitEon in taction 2. For 
n*t*#&rfti Of undry and binary constraint!, k-Cflna ia tency implies that if we 
pick values of any k-i variables frolt the unary nodas N and a k th variable, 
there Mill be a value of the kth variabJe> at the unary node, euch that the 
k values together satisfy all predicates involving th* ft variable* (•♦*+ 
they for* an instantiation of Nj uhera J i* the Bet of ft variables 
chosen]. Thlj indicates that L-conei atancy of a constraint network implies 
node consistency of the corresponding network of the type described in 
section 2* Z*-COn»iBtency ihpliaa arc cons 1 a t ancy and 3-cenai ttency Implies 
path conal»Hney + The firat two are obvious; the latter requlrse reducing 
path consistency to the three node cat*, uhkh is done by induction in a 
theorem of Mbntanari. 

Suppoas we seek a global eolu'ion by using depth firet tree eearch on 
the elenente remaining In the unary nodes of a k-consistent network of 
unary and binary constraints. Backup will Only be inltiatad below the kth 
leva I ■ [f the network is conitlManl. there will be no backup. Even 
hotter, and for arbitrary relaxed constraint netuorke H we can chooee an 
order k node, and tiae 1 ta members at the alternative paths through the 
firat k level t Of a search tree> only really doing (rat search on the 
reneirUng n-ft nodes. Of course, If k* hay* achieved fuU cons ib tency the 



mamtera of tha order n fioda gra tfrt solutions and no furth*r search Is 
r*ojulrad+ 



10. 5ynthai3» theore* 

■ 

Mb ara ran ready to itata tha theorem uhlch juatifiea tha Byntha*la 
a Igor I thm. 

THEOEEfli Tha relaxation ot tf>ai network co«*re (ponding to a constraint 

axpreeeicir C- A Cj is CODS i start and cample (a uUh respect to C, 

Jt2 l 

Tha proof will be by induction. Contiotercy and complaten-aaa of order 
ono ari oovioiifl. Our induction ftypotheeis is that fh« netHork ia 
h-eona I atant and h-completei ue uhah to frove k*-l-e-nna | ttency and 
k+l-ooaplatantta. 

Consistency! Ua uant to aho-M that a4 I M,, for J any cardinality k+1 
sunset of I, sr* k+l-conniatant. Nj t before rtlawation p corresponded to 
Cj< SO Included nothing which did not tatlifu Cj] relaxation does not add 
any elemente to $ node, Suppott thara BKiatf an «j In Nj Buch that a. 
does not aatlafu C H , for acme proper subaot H of J, 1,o. ai raatrlctad to 
H la not a meaner of C^ Plc,t * *** G of cardinally K iuch that hfa&cJ, 
Because of the local propagation during the relaxation process, we knou 
that aj satisfies N & , Thus aj restricted ta C f a^ is a tiembar of *U. Aa 
the network Is k-conalstent e^ raatrlcted to H is a mtfnhvt of Cu. But an 
raatricted to H i a flj reetrtcltd to Ht contradiction. 



Ccirpl eteness: Consider any ar not in Nj. for J gnLj cardinality k+1 
aubaet of I. Thara ara tuo poasi Hi M t I aa. |f Bj nag not in Nj before 
r#laMfltion t then aj doss net *sti*fy Cj> If- aj has rewovadl during the 
h* I a «a 1 5 or fjrocHaa, than ar dooB not satisfy Nij for sons cardinality k 
aubast H of J; by tha Induction: hypothaaia aj restricted to H does not 
k-fcJtiafy C. In either casa, 3j does not k+1-aatiafy C. 

There are. several inmadiatt corollaries, 

Corollary: It N| eorritponfJi (c th* oreiir n constraint defined Oy the 
conjrrafnt a-MprBasioo C* 

Corollary 2: C ia aatiafiable if and only if Nj in not the empty «t. 

Corollary 3t Th-i conttralnt network constructed by the *ynth«*l# 
algorithm opera ting on a constraint axpraasion C ia k-cona i stent with and 
fc-complate for C after atsfl k. The network conttruetid by the algorithm ■» 
consistent with and complete tor C, arnJ Nr corretpondi to C. 
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